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ABSTRACT 



This paper discusses one of the arguments that has been 



advanced against the use of standardized college admissions tests: the notion 
that their use leads admissions officers to reject non-Asian minority 
students on the basis of small and insignificant differences in scores. In 
the aggregate, the disadvantage minority students face as a result of their 
test scores is not a matter of small differences at the margin. For the 
purposes of this paper, it is accepted that college admissions tests show 
fairly typical group differences and that these differences are not biased 
against minorities as predictors of college grades. The differences are 
largely relative to the distribution of achievement within each group. The 
reasons for such differences are not explored; the size and effects are 
examined in practical terms using simulated data that mimic the typical 
differences found in large-scale testing programs. Databases were created 
that had a mean difference of 0.80 standard deviation between blacks and 
whites, somewhat smaller than those found on the Scholastic Assessment Test 
but larger than some of the most recent differences found in the National 
Assessment of Educational Progress. The effects of several simple admissions 
rules that depended solely on scores were studied, and a number of cut cores 
were set. Three scenarios, varying the numbers of black and white applicants 
and the cut scores, were considered. The simulations illustrate that when cut 
scores count heavily in admissions, the large differences in scores between 
black and white students have a major impact on the probability that black 
students will be admitted and on the composition of the accepted student 
population. These effects become progressively more severe as the selectivity 
of admissions increases. Results also illustrate the difficulty inherent in 
reconciling academic selectivity with increased equity of access to 
postsecondary education for non-Asian minority groups. (SLD) 



Reproductions supplied by EDRS are the best that can be made 
from the original document. 
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the Admission of Minority Students 
An Illustration 

Daniel Koretz 
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Peter S. and Carolyn A. Lynch School of Education 
Boston College 



In this paper, we discuss one of the arguments that has been ad- 
vanced against the use of standardized college admissions tests: the notion 
that their use leads admissions officers to reject non-Asian minority stu- 
dents on the basis of small and insignificant differences in scores. We do not 
discuss in detail any of the numerous other arguments about college admis- 
sions testing, although we do briefly comment on two of them: the possibil- 
ity of test bias against minorities, and the relative size of the gap between 
minority and non-minority students on admissions tests compared to the 
gaps shown on other achievement tests. 
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In the aggregate, the > 

disadvantage minority 
students face as a result of 
their test scores is not a 
matter of small differences 
at the margin. Efforts to 
improve access for 
minority students must 
address that fact. 



The average differences in performance between non- Asian 
minority students and majority students are very large and have 
a major effect on the selection of students and the composition 
of the selected student population. This effect becomes progres- 
sively larger as schools become more selective, not because of 
any idiosyncrasy of the tests used for selection, but simply be- 
cause of the distribution of student performance. Some students 
(in any racial or ethnic group) will always fall on the margin of 
acceptance, of course, and for those individual students, a small 
change in test scores might tip the balance toward acceptance 
or rejection. This fact, however, should not obscure the magni- 
tude of the average differences between the groups. In the aggre- 
gate, the disadvantage minority students face as a result of their 
test scores is not a matter of small differences at the margin. 
Efforts to improve access for minority students must address 
that fact. 



Are Admissions Tests Biased or Atypical? 

A full discussion of possible bias in college admissions test- 
ing is beyond the scope of this paper, as is an evaluation of the 
agreement between admissions tests and other measures of stu- 
dent achievement. The large differences in scores discussed 
here, however, cannot be interpreted without some informa- 
tion on these two questions, and a brief synopsis is provided 
here. 



A simple mean difference in test scores between groups - 
that is, a finding that the average score of one group is mark- 
edly lower than that of another - does not in itself indicate test 
bias. Bias arises when the scores for one or more groups are 
misleading - for example, if they are low because of unfair ques- 
tions. 



Copious research has not shown admissions tests to be bi- 
ased against minorities. Admissions tests are used to predict 
performance in college, and they are most often validated by 
assessing how well they predict the early performance of stu- 
dents accepted to a given college - specifically, their freshman- 
year grades or grade-point averages (GPAs). If the tests were 
biased against minority students, one would expect to find that 
minority students perform better in college, on average, than 
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their scores predict. But that is not the case. In the case of male 
students, research finds the opposite: on average, black and 
Hispanic students achieve somewhat lower freshman grades 
than their scores predict. Black and Hispanic women achieve 
on average about the GPAs their test scores predict. 

The average differences between minority and non-minor- 
ity students on admissions tests are not atypically large com- 
pared to the differences typically found on tests of educational 
achievement. In 1999, the mean differences between black and 
white students on the SAT-I were 0.89 standard deviation on 
the verbal scale and 1.0 on the mathematics scale. 1 (When dif- 
ferences are expressed in standard deviations, they can be com- 
pared across tests.) A recent review of large-scale studies of 
secondary-school students showed that black-white differences 
in composite scores (that is, scores summing across subjects) 
ranged from .82 to 1.18 standard deviations. 2 The differences 
in individual subjects varied somewhat more. While the gap 
between blacks and whites on achievement tests has narrowed 
in recent decades, it remains very large. 3 For example, in 1994 
the gap in the National Assessment of Educational Progress 
(NAEP) trend assessment still ranged from 0.66 standard de- 
viation in reading to 1.08 in science. 4 

The similarity in the results of admissions tests and other 
large-scale achievement tests also argues against bias. Consid- 
erable work has gone into limiting bias in these many tests. 
Moreover, examination of the questions of which the tests con- 
sist shows large performance differences between blacks and 
whites on items that are clearly not biased, such as simple math- 
ematics problems. 

The lack of bias and rather typical mean differences shown 
by current college admissions tests do not mean that all pos- 
sible admissions tests would yield the same results. Indeed, 
substituting different tests for the SAT-I or ACT would improve 
the prospects for some students while lessening them for oth- 
ers. It does suggest, however, that the current test results are 
not misleading in the aggregate and that only substantial 
changes in admissions testing, such as the measurement of 
important skills or content not currently assessed, could greatly 
change group differences. 




The lack of bias and rather 
typical mean differences 
shown by current college 
admissions tests do not 
mean that all possible 
admissions tests would 
yield the same results. 
Indeed, substituting 
different tests for the SAT-S 
or ACT would improve the 
prospects for some 
students while lessening 
them for others. 
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For purposes of this paper, then, we accept that college 
admissions tests show fairly typical group differences and that 
these differences are not biased against minorities as predica- 
tors of college grades. These differences are large relative to 
the distribution of achievement within each group. They could 
stem from a variety of factors, which we will not examine here. 
We will merely explore the size and effects of these differences 
in practical terms. 

Before analyzing the effects of test scores on admissions, 
we will translate the differences in standard deviations into 
another metric that is easier to understand. A mean difference 
of 0.60 standard deviations, which is smaller than any of the 
black-white differences noted above, would place the average 
black student at the 27 th percentile among white students (Table 
1). That is, only 27 percent of white students would score as 
low as or lower than the average black student. A more typi- 
cal difference of 0.80 standard deviation would place the av- 
erage black student at the 21 st percentile among whites. A gap 
of a full standard deviation - the size of the gap on the SAT-I 
mathematics scale - places the average black student at the 
16 th percentile among whites. 
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Differences in 
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How We Carried Out Our Analysis 

We wanted our analysis to reflect the general pattern of 
group differences in performance rather than any idiosyncra- 
sies of any particular test or test-taking group. Accordingly, 
rather than using data from the SAT or ACT testing programs, 
we simulated data that mirror the typical differences found in 
large-scale testing programs. 



We created databases that had a mean difference of 0.80 
standard deviation between blacks and whites - a difference 
modestly smaller than those found on the SAT but larger than 
some of the most recent differences found in NAEP. We made 
the scores of simulated black students a little less variable than 
those of whites. 5 This is consistent with the pattern shown in 
numerous studies. 6 For simplicity, we set the mean of the scores 
to zero and the standard deviation to 1. Thus, a score of zero in 
our data corresponds roughly to an SAT-I score of 500. 

We then examined the effects of several simple admissions 
rules that depended solely on scores. We set a number of cut 
scores on the test, and all students scoring above the cut were 
"accepted," while all those below it were "rejected." We con- 
sidered no other characteristics of students. These are overly 
simple selection rules that no colleges follow, and indeed using 
them would be inconsistent with accepted professional stan- 
dards. These unrealistically simple rules, however, isolate the 
effect of test scores. 



The Effect of Test Scores: Three Scenarios 

We present three scenarios. For simplicity, all consider only 
black and white applicants. The first sets the cut score at the 
overall mean and uses equal numbers of black and white ap- 
plicants. The second retains the equal numbers of applicants 
but imposes a higher cut score, set arbitrarily at one standard 
deviation above the mean, roughly the 84 th percentile. These 
two show the pure effect of test-based selection, independent 
of the smaller number of black applicants at most colleges. 
Comparison of these two scenarios shows the effect of greater 
selectivity. The final scenario maintains the cut score at one stan- 
dard deviation above the mean but reduces the number of black 
applicants to a more realistic 15 percent of the total. 7 




◄ We then examined the 
effects of several simple 
admissions rules that 
depended solely on scores. 
We set a number of cut 
scores on the test, and all 
students scoring above the 
cut were "accepted," while 
all those below it were 
"rejected." 
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§» SCENARIO 1: 50 percent black applicants, cut 
score at the overall mean 

The distributions of scores in our first simulated case, like 
those in many actual test databases, roughly follow the normal 
curve (Figure 1). The mean score for all students is set to zero, 
and the standard deviation is one. Thus, a value of +1.0 repre- 
sents a score one standard deviation above the overall mean, 
or roughly the 84 th percentile in the entire population, while a 
value of -1.0 represents a score one standard deviation below 
the overall mean, or roughly the 16 th percentile in the entire 
population. 

Because black applicants have an average score .8 standard 
deviation below that of white applicants, black students are 
clustered around an average that is well below the overall mean 
(roughly .68 standard deviation below the mean; see Figure 1). 
White students are clustered around their mean, which is mod- 



the scores of black students vary somewhat less than those of 




estly (.12 standard deviation) above the overall mean. Because 



Figure 1 



white students, black applicants 
are bunched a little more tightly 
around their average scores than 
are white students. The dashed 
vertical line in Figure 1 repre- 
sents the cut score, which is set 
at the overall mean score of 0. 
Everyone with scores above this 
line was "accepted," while all 
students below the line were "re- 
jected." 



Cut Score at the Overall Mean, Equal 
Numbers of Black and White Applicants 



Cut Score 




Blacks 
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Score in Standard Deviations 
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Even with the relatively low 
cut score of 0 (the overall mean 
score), a much smaller percent- 
age of black than of white stu- 
dents is accepted: About 20 per- 
cent, compared with 55 percent 
of white applicants (Figure 2). 
The percentage accepted, shown 
as a bar chart in Figure 2, is 
equivalent to the portions of the 
distributions above the cut score 
in Figure 1. 
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Percentages Accepted by Race, Equal Numbers of 
Applicants and Cut Score at Mean 
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Use of this low cut score causes blacks to be underrepre- 
sented in the admitted student body by roughly a factor of two, 
relative to their representation in the pool of applicants. Al- 
though they constitute half of the applicants, they constitute 
only 27 percent of the selected students (Figure 3). 



Composition of Applicant Pool and Admitted Group, 
Equal Numbers of Applicants and Cut Score at Mean 






Figure 2 



d 

v 

u 

ju 



100 

90 

80 

70 

60 

50 

40 

30 

20 

10 

0 





H White Students 
§1 Black Students 



Applicant Pool Admitted Group 






Figure 3 



ERjt 



8 



7 



NBETPP 



The Impact of Score Differences on the Admission of Minority Students 



SCENARIO 2: 50 percent black applicants, 
cut score at 1 standard deviation above the 
overall mean 

The second scenario retained the same applicant pool and 
distribution of scores but was more selective, setting the cut 
score at one standard deviation above the mean (Figure 4). This 
would equal 616 on the SAT I-Verbal and 625 on the SAT I- 
Mathematics - appreciably above the 25 th percentile of scores 
of freshmen at the University of Pennsylvania on the SAT I- 
Verbal (560) but below the 25 th percentile of those students on 
the SAT I-Mathematics (650). 8 











Figure 4 





Raising the cut score from the mean to one standard devia- 
tion above sharply reduces the percentage of both white and 
black applicants accepted (Figure 4). This reduction is particu- 
larly severe, however, for black applicants. Roughly 17 percent 
of white students are accepted (Figure 5), compared with 55 
percent when the cut score is at the mean. Only about 1 per- 
cent of black applicants are accepted (Figure 5), compared with 

about 20 percent when the cut 
I score is at the mean. 



Cut Score at +1 Standard Deviation, Equal 
Numbers of Black and White Applicants 




Raising the cut score also has 
a dramatic effect on the racial 
composition of the accepted stu- 
dent population. While the ap- 
plicant pool is constructed to be 
half black and half white, black 
students constitute barely 6 per- 
cent of the accepted students 
(Figure 6). With the cut score at 
the mean, blacks constituted 
about 27 percent of the students. 
In other words, with a cut score 
at the mean blacks are 
underrepresented in the student 
population by a factor of about 
two; with a cut score at one stan- 
dard deviation above the mean, 
blacks are underrepresented by 
roughly a factor of eight. 
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Figure 5 



Composition of Applicant Pool and Admitted Group, 
Equal Numbers of Applicants and Cut Score at 
1 Standard Deviation Above Mean 






Figure 6 
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SCENARIO 3: 15 percent black applicants, 
cut score at 1 standard deviation above the 
overall mean 

The final scenario again uses a cut score of one standard 
deviation above the mean but reduces the black applicant pool 
to a more plausible 15 percent of the total. The result is shown 
in Figure 7. This is identical to Figure 4 except for the smaller 
number of black applications. 

Because the cut score and the average score for each group 
remain unchanged, the percentage of black and white students 
accepted remains the same: about 17 percent of white appli- 
cants but only 1 percent of black applicants. The smaller pool 
of black applicants increases the homogeneity of the accepted 
student population. While the applicant pool is 15 percent black, 
the accepted student body is roughly 99 percent white (Figure 8). 





* w * 
<a *> 




Figure 7 
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Composition of Applicant Pool and Admitted Group, 
1 5% Black Applicants and Cut Score at 1 Standard 
Deviation Above Mean 
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Figure 8 
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Implications 


These simulations illustrate ► 
that when test scores count 
heavily in admissions, the 
large differences in scores 
between black and white 
students have a major 
impact both on the 
probability that black 
students will be admitted 
and on the composition of 
the accepted student 
population. These effects 
become progressively 
more severe as the 
selectivity of admissions 
increases. 


These simulations illustrate that when test scores count 
heavily in admissions, the large differences in scores between 
black and white students have a major impact both on the prob- 
ability that black students will be admitted and on the compo- 
sition of the accepted student population. These effects become 
progressively more severe as the selectivity of admissions in- 
creases. For example, with a cut score at the overall mean, black 
students would be underrepresented by a factor of two in the 
student body; with a cut score at one standard deviation above 
the mean, they would be underrepresented by a factor of 
roughly eight. The relatively small number of black applicants 
to college, which stems in part from their relatively small num- 
bers in the cohort of college-age students, changes neither the 
probability that black students will be accepted nor the pro- 
portional underrepresentation of black students in the student 
body. It does, however, further increase the homogeneity of the 
student body. 

Of course, few if any schools select students solely on the 
basis of a cut score on an admissions test, and more common 
selection processes that give weight to other factors will often 
place black students at less of a disadvantage. Nonetheless, 
unless test scores are given very little weight or are offset by 
other factors on which minority students have an advantage 
relative to whites, the average test-score disparity will gener- 
ally have a severe impact on admission to selective colleges. 

The values used in the simulation were chosen to be repre- 
sentative of a broad range of tests rather than any single col- 
lege admissions test. Because the mean difference between 
blacks and whites is somewhat larger on the SAT-I than in these 
simulated databases, using values from the SAT-I would exac- 
erbate the results presented here, albeit not greatly. 
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A parallel simulation for Hispanic students nationwide 
would also show a severe impact, but smaller than that for 
blacks. Data from large-scale assessments typically show His- 
panic students scoring somewhat higher, on average, than 
blacks. 



It is important to emphasize that the progressively more 
severe impact that accompanies greater selectivity does not stem 
from any peculiarity of college admissions tests. It stems pri- 
marily from the roughly normal distribution of scores - that is, 
from the fact that most students have scores quite close to the 
average for their group, while few have scores much higher or 
lower than the average. This pattern is slightly exacerbated by 
the fact that black students show modestly less variable test 
scores than do white students. That is, the percentage of black 
students scoring either much higher or much lower than the 
black average is smaller than the corresponding percentage for 
white students. 

These results illustrate the difficulty inherent in reconciling 
academic selectivity with increased equity of access to post- 
secondary education for non-Asian minority groups, particu- 
larly at selective colleges and universities. Most colleges con- 
sider a variety of other factors in addition to test scores in 
making admissions decisions, and to the extent that those fac- 
tors are not strongly correlated with test scores, the problems 
illustrated here will be ameliorated somewhat. The differences 
between minority and majority students in academic perfor- 
mance as measured by diverse standardized tests are so large, 
however, and their effects are so substantial at academically 
selective colleges, that it will be difficult to offset their impact 
without confronting them directly. 
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These results illustrate the 
difficulty inherent in 
reconciling academic 
selectivity with increased 
equity of access to post- 
secondary education for 
non-Asian minority groups, 
particularly at selective 
colleges and universities. 
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About the National Board on Educational 
Testing and Public Policy 

Created as an independent monitoring system for assess- 
ment in America, the National Board on Educational Testing 
and Public Policy is located in the Peter S. and Carolyn A. Lynch 
School of Education at Boston College. The National Board pro- 
vides research-based test information for policy decision mak- 
ing, with special attention to groups historically underserved 
by the educational systems of our country. Specifically, the 
National Board 

0 Monitors testing programs, policies, and products 

0 Evaluates the benefits and costs of testing programs in 
operation 

0 Assesses the extent to which professional standards for 
test development and use are met in practice 
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1 The College Entrance Examination Board (1999). 1999 College- 
Bound Seniors, National Report. New York: author. 

2 Hedges, L. V., & Nowell, A. (1998). Black-white test score conver- 
gence since 1965. In C. Jencks and A. Phillips (Eds.), The Black 
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and Nowell, op. cit.,; Koretz, D. (1986), Trends in Educational 
Achievement, Washington, D.C.: Congressional Budget Office. 

4 Hedges and Nowell, op. cit. 

5 Specifically, we set the black/white variance ratio to .81. 

6 See Hedges and Nowell, op cit. 

7 Note that the distributions of scores used in all three scenarios are 
based on a population that is 15 percent black and 85 percent 
white. This results in a white average that is slightly above the 
overall average and a black average that is much lower than the 
overall average. If we had regenerated data for the scenarios with 
equal numbers of applicants based on a population that is half 
black and half white, the mean difference between blacks and 
whites would have remained the same, but both group means 
would have increased relative to the overall mean. (They would 
have been equidistant from the overall mean). This would have 
been unrealistic and would have confounded the comparisons 
among the scenarios. 
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About the National Board 
on Educational Testing 
and Public Policy 

Created as an independent monitoring system 
for assessment in America, the National Board on 
Educational Testing and Public Policy is located in 
the Peter S. and Carolyn A. Lynch School of 
Education at Boston College. The National Board 
provides research-based test information for policy 
decision making, with special attention to groups 
historically underserved by the educational 
systems of our country. Specifically, the 
National Board 

• Monitors testing programs, policies, and 
products 

• Evaluates the benefits and costs of testing 
programs in operation 

• Assesses the extent to which professional 
standards for test development and use are 
met in practice 

This National Board publication series is supported by 
a grant from the Ford Foundation. 
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